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DETAILED ACTION 

1 . In view of the appeal brief filed on 08/1 1/08, PROSECUTION IS HEREBY 
REOPENED. New grounds of rejection are set forth below. 

To avoid abandonment of the application, appellant must exercise one of the 
following two options: 

(1 ) file a reply under 37 CFR 1.111 (if this Office action is non-final) or a reply 
under 37 CFR 1.113 (if this Office action is final); or, 

(2) initiate a new appeal by filing a notice of appeal under 37 CFR 41 .31 followed 
by an appeal brief under 37 CFR 41 .37. The previously paid notice of appeal fee and 
appeal brief fee can be applied to the new appeal. If, however, the appeal fees set forth 
in 37 CFR 41 .20 have been increased since they were previously paid, then appellant 
must pay the difference between the increased fees and the amount previously paid. 

A Supervisory Patent Examiner (SPE) has approved of reopening prosecution by 
signing below: 

Response to Arguments 

2. Applicant's arguments with respect to claims 1 -6,9-13, 15-18,21, and 22 
have been considered but are moot in view of the new ground(s) of rejection. 

Applicant argues that Johnson does not teach or suggest the first speech 
recognition engine permits a plurality of ports to be used on behalf of a plurality of users 
and the system further comprises a port monitor coupled to the first speech recognition 
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engine and to the evaluation logic, wherein the port monitor determines a number of 
currently available ports and, if the number of currently available ports exceeds a 
threshold selecting and using the first speech recognition engine (Appeal brief, pages 
10-13). 

The examiner agrees, but this limitation is now rejected in view of Endo et al., in 
view Watanabe et al. Please see claim rejection below. 

Claim Rejections - 35 USC § 103 

2. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

3. Claims 1 - 4, 6, 9 - 13, 15 -18, 21, and 22 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Endo et al., (US Patent 7,228,275) in view of Watanabe et 
al., (US Patent 4, 641,342). 

As per claims 1, and 9, 15, and 21, Endo et al., teach a system, comprising: 
a first speech recognition engine; a second speech recognition engine (Abstract, 
lines 1 - 3); and 

evaluation logic ("decision module") coupled to the first and second speech 
recognition engines, the evaluation logic evaluates the first and second speech 
recognition engines based on evaluation signals from a user and, based in part on the 
evaluation, selects one of said speech recognition engines to process additional speech 
signals from the user (Abstract, col. 2, lines 28 - 48). 
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However, Endo et al., do not specifically teach the first speech recognition engine 
permits a plurality of ports to be used on behalf of a plurality of users and the system 
further comprises a port monitor coupled to the first speech recognition engine and to 
the evaluation logic, wherein the port monitor determines a number of currently 
available ports and, if the number of currently available ports exceeds a threshold 
selecting and using the first speech recognition engine. 

Watanabe et al., teach detector can also be used to selectively switch an active 
one of a plurality of user channels to one of a smaller number of voice recognizers. A 
change-over switch 14 connects m voice pattern outputs to n separate recognition 
input terminals 121, 122, . . . , 12j, . . . , 12nof a recognition means 15 which 
recognizes the voices received on its n separate recognition input terminals as the 
outputs from the change-over switch 14. The recognition means 15 can recognize n 
separate voice simultaneously (Abstract, lines 7-10; col.4, lines 5-12; col. 6, lines 4 
-6). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to recognize n separate voices simultaneously using a 
single recognizer as taught by Watanabe et al in Endo et al., because that would help 
monitor when to use different speech recognizers at the same time. 

As per claims 2, 1 0, Endo et al., in view of Watanabe et al., further disclose a 
switch coupled to the first and second speech recognition engines and the evaluation 
logic, wherein, based on the evaluation, the evaluation logic causes the switch to 
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release a connection to the speech recognition engine that was not selected (Endo et 
al; "selects the speech text with the highest raw confidence score... for controlling the 
back-end application"; col. 6, lines 20 - 24). 

As per claim 3, Endo et al., in view of Watanabe et al., further disclose a 
communications mechanism and, based on the evaluation, the evaluation logic selects 
the communications mechanism that is not the first or second speech recognition 
engines (Endo et al; "selects the speech text with the highest raw confidence score... for 
controlling the back-end application"; col. 6, lines 14 - 24). 

As per claim 4, Endo et al., in view of Watanabe et al., further disclose if the 
number of currently available ports does not exceed the threshold, comparing outputs 
from the first and second speech recognition engines, and selecting the second speech 
recognition engine if the outputs are identical (Endo et al; "confidence scores are the 
same"; col. 8, lines 34 - 37) 

As per claim 6, Endo et al., in view of Watanabe et al., further disclose if the 
number of currently available ports does not exceed the threshold, the evaluation logic 
receives a first confidence score from the first speech recognition engine and a second 
confidence score from the second speech recognition engine and selects the second 
speech recognition engine if the confidence score of the second speech recognition 
engine is equal to or higher than a threshold (Endo et al; col .2, lines 45 - 48; col. 8, lines 
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As per claim 11 - 1 3, 1 6 -1 8, 22, Endo et al., in view of Watanabe et al., further 
disclose means for evaluating a parameter comprises means for assessing the relative 
accuracy of the first and second means for recognizing speech; wherein the means for 
evaluating a parameter comprises means for assessing the relative performance of the 
first and second means for recognizing speech; and wherein the first and second means 
for recognizing speech comprise a means for determining a confidence score 
associated with the voice input (Endo et al; "confidence scores for selection of the most 
accurate one of the recognized speech texts"; col.1 1 , lines 4 - 6). 

4. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over Endo et 
al., (US Patent 7,228,275) in view of Watanabe et al., (US Patent 4, 641 ,342), and 
further in view of Kemble et al., (US Patent 7,072,837). 

As per claim 5, Endo et al., in view of Watanabe et al., do not specifically teach 
that the evaluation logic determines a response time for each of the first and second 
speech recognition engines and selects the second speech recognition engine if the 
response time of the second speech recognition engine is equal to or shorter than the 
response time of the first speech recognition engine. 

Kemble et al., teach that the processing tasks can be allowed only a 
predetermined and limited amount of time for completion. Specifically, the speech 
recognition system can restrict the selection of recognition results to only those from 
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possible recognition results provided by the processing tasks which complete execution 
within the predetermined time limit (col.7, lines 51 - 57). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to consider response time in speech recognition systems 
as taught by Kemble et al., in Endo et al., in view of Watanabe et al., because the 
response time is more critical than the accuracy of the speech recognition (col.7, lines 
50, and 51). 

Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Please see PTO-892-form. 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to LEONARD SAINT CYR whose telephone number is 
(571) 272-4247. The examiner can normally be reached on Mon- Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571) 272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is (571)- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
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For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
LS 

10/21/08 

/Richemond Dorvil/ 

Supervisory Patent Examiner, Art Unit 2626 



